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The £ducdtioDal Achievement Act was enacted originally in 1969 
because of a concern expressed by citizens and legislators that many 
children were not learning to read adequately. The Act has as its 
major focus children who are substantially, behind other children in 
their reading achievement test scores. 

Because of the funds ^available, the original pilot character of 
the Act and the Besire to achieve maximum impact with the program, the 
Act has never bedn extended to all Colorado school districts. It has 
been a program liftntted to from 21 to 25 projects each year with from 
63 to 72 districts\^nvolved, many of which were members of Boards of 
Cooperative Services. There was no funding provided ih .1973-74 or 
1974-75. 

A variety of agencies conducted the evaluation- of the Act during 
its f^irst three years (fis:al years 1970, 1971 and 197Z). These 
evaluators carried out their. functions under certain handicaps which' 
limited their capacity to produce information in which a degree of 
confidence could be placed. Tfjere ivas no uniform pre-test, post-test 
arrangements, no unifonY measuring instruments anc no examination of 
the attitudes of students. The evaluators were not involved prior to 
the operation of the program in the establishment of a general evaluation 
design. Cost factors were distorted because full program cost 
information was "not available, g , 

For^ 1973, jt was decided that the evaluation should remain 
within the Department of Education as much as possible, Although 
outride personnel were utilized to some extent, as they were needed. 
A pre-post design was established, a procedure for analysis, a full- 
cost accounting procedure was designed and other improvements made to 
make the evaluation more meaningful. 

With the improvements in the evaluation design; I am pleased to 
transmit this report of the Educational Achievement Act to the General 
Assembly iind the people, of Colorado. 



Calvin M. Frazier 
^ . Commissioner of Education 
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SUMMARY AND RECOMMENDATIONS 



The Educational Ach,ievement Act, 22-22, CRS 73, was enacted originally 
in \969 because of a concern expressed by citizens and legislators that 
many children were not learning to read adequately. The Act had as its 
major focus children who were substantially behind other children in their 
reading achievement test scores. Because of the funds available, the 
original pilot character of the Act, and the,desire to achieve concentrated 
impact with the programs, the Act was never extended to all Colorado school 
districts. It was a program limited to from 21 to 25 project^. eafh year 

« 

with from 63 to 72 districts involved, many of ^ Which were members of Boards 
of Cooperative Services. The number of students participating ranged from 
6700 to 13,000 over the years of the Act. During the four years of funding 
$5.5 mill i(yi have been distributed. The 1972-73 programs were 



■Colorado Educational Achievement Act did lead to increased gains by students 
who were behind in reading achievement. Students who had been averaging 
six to eight months reading gain per school year before the program . 
increased their gain by an average of more than 50 percent. \hat is, 




averaged seven to twelve months gain, depending on grade level and test. 
Thus, while only abou't one-third of the students had been averaging seven 
months gain per year before thef program, well over half of the students 



gained seven months during the study. Most programs showed moderate 
reading achievement gains of seven to /nine months during the seven months 



carefully studied, and results are summarized in this chapter. 

The'additional\ reading program effort produced by the funds in the 





s-of -^*e-^:est-rng -|5er4od the students in these projects 



testing period. A few programs showed high gain and a few gained less 
than {irade equivalent or-gained less than the students had averaged 
before the-'program started. Attitude changes, for the most part, wer^ 
neutral, with as many unfavorable as favorable changes pcciirring.. 

An analysis was made. of students by ethnic Category. Each student was 
categorized as Black, Spanish surnamed or Chicano, American Indian, ^ 
Or-iental, or Other. Because there were so few the Indian and Oriental 
categories were combined Citi/ Other which was primarily Caucasion. ' 

Ethnic category comparisons found "Other'*, Spanish surnamed, and 

Blacks showing- reading achievement gain in that order after adjusting for 

age, sex and pre-test scores. In attitudes the "Other" 'student category 

scored the lowest in attitudes with Blacks and Chicanos the most favorable, 

but in attitude change there were no consistent patterns^ by ethnic category. 

' For the purpose of the study a program was identified by those reading 

materials most frequently used within a program, it cannot be said that 

materials alone can be credited for the success or failure of a program. 

Among the more successful programs in^^terms of positive achievement growCh 

and positive attitude change the followilig characteristics were found to 

.be most common: 

a prescription based on diagnosis of pupils 
a developmental sequence of skills 

a wide variety of instructional reading materials £^vailable • 
pupil problems identified early 

^taff involvement in planning^ , 

paid^eacher aides • 
aide training 

teacher training ^ 
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The funds appropriated for use in FY 73 were distributed among 21 
projects. For every .reading achievement dollar expended by the State, local 
school districts contributed on the average an additional $1.42 to the 
same purpose. Of the total funds expended, instructional salaries 



constituted 59 percent and local district administration constituted 
2 percent. The average cost per pupil (state, local and federal) 

across all py^oje'cts was $180.53. 

Interpretation of results must be. tempered by various sources of 
internal invalidity and error. TheVograms were selected by the schools. 



and thus differences in teac.iers»^ school characteristics and other student 

variables were not controlled/A uniform cost allocation was not followed 

by the schools and thus cost differences in local contributions were- 

.exaggerated. Local salary schedules, wfvich can differ by 25 percent, make 

cross-district cost cpmparisbns difficult. Sinte the program materials . 

were all tested, successfully by the original developers, .variations in 

achievement success reported here may, b^sBeq partly as the effect, of 

differences in implementation in schoof^settfjligs . 

The following conclusions, based on the findings from this study, are 

offered 'to persons planning program 'devfe'lopment in reading achievement: 

1. Additional affort, made possible by the incentive 
of additional funds, can produce significant reading 
achievement gains. ' , 

2 Inservice education for all teaching staff which is 

' relevant tfl' reading remediatipn in the classroom can 
V produce results. 

3 When programs are established, the data seems to- show 
that those which allow the te'achfer wide latitude in the 
choice of materials and procedures produce good results., 

* 

4. Organized commercially prepar ed programs may or may not 
produce results depending upon a wide variety of other 
• ■ variables in the learning envi>*6nment. / 



Chapter 2' 
^ ■ INTRODUCTION 



PURPOSE AND PLAN 

. ~t(rTorado students "score above national reading norms in the lower 

1 

grades and below norms in the upper grades. A comparison of 17-year- 
olds on a pool of items from the National Assessment of Educational 
.Progress showed Colorado 17-year-olds scoring as well or better than 
th^ national sample. 2 The median reading level for children in Colo- 
rado title I programs is about the 30th percentile. ,3- Overall, it is 
estimated that 10" to 20 percent of Colorado's 540,000 , students have 
reading difficulties. / ^ ' < 

The Colorado Educational Achievement Act was enacted in 1969 be- 
cause of legislative and public concern over reading achievement. This 
is the fourth annual report which has been completed under the provisibns* 
of. the Educational Achievement Act of Colorado (E.A.A.C.). The purpose 
Of this Act is established in Section 2 of 22-22, CRS 1973: 

22-22 CRS 73 Purpose— (1) It is the purpose of this 
Article to assist certain local school districts to\ 
carry out programs for educational achievement of those 
students in grades one though six who are below their 
assigned grade in reading at least: three-tenths of 
• a grade level in ficst grade; sixrtenths of a grade 
level in second grade; nine-tenths of a grade level in 

third grade; one and two-tenths of a grade level in 

fourth grade; one and five-^tenths of a grade level in 
fifth grade;^and one and eight-tenths of a grade level 
in sixth grade; and In grades seven through twelve, 
two or more grade levels below their assigned grade 
in reading, as determined by standardized achievement 
tests as approved by the State Department of Education. 

To accomplish the above purpose, 22-22 CRS 73 states that appropriate 

funds may be used to accomplish improved utilization of educational 

personnel, training and development programs, new curricula and equip- 



ment. 



The Departmervt of Education attempted to keep itself free from 
the imposition of personal bias in regard ;to the kinds of solutions 
school districts would use in the development of FY 73 programs. App- 
lication forms were distributed tq districts which simply asked them 
to identify their needs, goals and objectives, activities they would 
employ to improve the >dentified\ pupils and their means of evaluation. 

^ These proposals were received on a. competitive basis on July 17,* 
1972. They were immediately transmitted to a five person p^el of 
reading specialists which ranked the proposals in priority order. To 
have funded all of the proposals received would have required an appro- 
priation of $2,066,707, The General Assembly had- appropriated $1,000,000 
for distribution tio' districts. Using the panel's ranking, the Colorado 
Board of Education approved the first- twenty-one projects of those 
listed in rank order. These projects would require the $1,000,000 appro- 
priated by the General Assembly. 

After the projects were selected, the Labroatory of Educational 
Research at the University of Colorado was employed to assist in the 
establishment of an evaluation design which would produce the information 
needed to determine the results of these projects. The Laboratory pre- 
pared an attitude survey whi^h was to be administered ^t the beginning 
of the project and a.t the end. Or* Kenneth -Hopkins met with all project— 
directors where the Gates-MacGinitie Reading Tesfwas selected coopera- 
tively by them as the comnon instrument for all projects. The Labora- 
tory then designed an achievement test 'data form to collect achievement 
information. All -pupils were , subsequently tested in the fall of 1972. 
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All projects were visited by the Department of Education consultant 
duringjth^year of operation to assure program fidelity and. to collect 
further details about the program. The programs 'were examined to deter- 
mine. whether or not the activities described in the original proposal ^ 
were actually being conducted in that manner. 

At the end of the school year, the pupils were tested again so 
that a measure of this achievement could be taken in comparison with 
the fall measure. 



COLORADO DEPARTMENT 



OF EDUCATION ADMINISTRATION OF EAAC 
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Costs \ 



^ During the 1973\ fiscal year, the Compensatory Education Unit of 
the Colorado Department of Education employed one professional staff 
member for .75 of his time and one clerical staff member for .50 of her 
time for the administration of the EAAC program. From the administrative 
appropriation of $25joOO, $18,200 w-»s spent fo'r professional and clerical 
salari3S and fringe benefits; $5,695 was spent for contracted evaluation 
services; $320 for travel, and $785 for printing, postage, equipment, 
repairs, etc. \ " ' 

Activities ' • ^ 

The following activities were conducted by the Department stiaff 
as a function of the appropriation: ^ 

1. ^ Assistance to sVate Board of Education in the development^ 

of policy related to the administration of the Act. 

2. Preparation and mailing of instructions to school districts 
regarding application for funds. 

3. ' Completed contract JyUh^an instructed panel of reading 

specialists for proposal^ selection process. 
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4. Arranged contract with the University o^^Col oracfo , Laboratory • 
of Educational Research^to assist with evaluation design. 

5. Nfegotjated budgets of highest ranking proposals downward to 
effect most pupils for leasts cost. / * * 

I - ^ ' 

6. Prepared matferiaU for State Board approval of prp-jects**^ • ^ 

7. Conducted meeting of all .approved project ^directors to select * * 
* a common test instrument*. Agreed on resting dates and conditions 

/ of testing. . ^ ^ , 

8. Prepared financial report form which would account for totaV 
e)^endi^res both from EAAC and other sources. ^ 

9'. Conducted meetings with EAAC Advisory Committee regarding 
current operation .and new legislation. . • . r " | 

^ 10. Met with Interim Committee on Public Education and prepa^red * ^ / 

materials and reports on past and current operation .of EAAC. < 

11. Prepared drift pf i»ew legislation related to criteria estab- 
•lished by Interitff Committee. 

^,12. Met with panels of reading specialists from school districts' 
regarding new legislation and obtained^tbfi^ recommendations". 

• • 

13. Met with Senate Education Committee to review arid revise 
^ draft bill.^ ^ -J 

14. Attended hearing^ of both House and Senate to be available 
iiii for questioning.. 

15. Visi.ted all approved projects to determine thaet projects / 
were operating within the conditions of the law and their 
agreed objectives. Collected progranKdesr-^iption information 
during visit and assisted directors with , oblems.^ ,4' 

16. Wrote and published article on EAAC encouraging** other 

. districts to examine project distlrict? for>-*their oWn benefit.' 

• 17.. Prepared and mailed instructions for final reporting'^to all 

districts*. V ' * * • ' 

^ 18." Prepared and delivered talk to Vocational Wucation A^dvisory 
^ Committee relative to , the relationship of reading and \fpca- 

tional Education. 

19. Arranged contract for .data analysis 

20. Collected evaluation data^and prepared it for analysis. 

21. Wrote evaluation report. ^ ' 

i2' / 
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Reactibn 

— * 

The general results of the 'preceding activities are reflected in 
the balance of this 'report. As these projects have impacted upon local 
districts and subsequently upon students in those districts, the result 
is ultimately the change In students* reading ability which had its ori 
gfns in the legislature and the Department of Education, 

— ^However, otJcier resuHs than student improvement occurred. These 
may be referred to as process results rather thar^ product results as 
in the case of student improvement. They reflect both the adequacies 
and inadequacies of the procedurqs employed to 'implement the program, 

1, The numbers of project applicants were few (37 out of 181 
districts). This maybe attributable to the lateness of 
the appropriation, the short time for preparation of pro- 

' posal s and the f^ct that many school personnel were on 
vacation at the time proposals were called for rather 
than lack of' interest or desire. Instructions to districts 
were iqa'il^d June^Zp, ]^72 and the deadline for applica- 

. tion Wis'^'i)uly 17^^972, 

2, Several tomplaints were received relative to the selection 
of projects for approval. The implication of such complaints 
was that if one district in the state is entitled to money 
from the state for this problem then all districts should 

be entitled to it since all districts experience the prob- 
lem of low-reading achievement in varying degrees. The State 
Board subsequently, took the position that in future legis- 
lation such grants should be non-competitive, 

3: Good working relationships between the Department of Educa- 
tion and Committees of, the General Assembly where communi- 
cation was taking place. Face to face discussion in small^ 
meetings made it possible for staff and legislators to uWe 
stand-each other's concerns about new legislation. Unfortu- 
nately b'fecause of the, press of other business in the legis- 
lature, tinrexdid not'iiermit the same kind of discussion with 
the House Committee that took place in the Senate, As a re 
^w.^. suit, the bill whfch |f)assed the Senate did not reach the 
floor of the'House, 
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4, The process established for proposal development, proj*^ct 
operation and reporting represents a practical model fbr 

* . ^ Accountability and PPBES in a* rather primative state- \Tt 
utilizes the rather old concept of crosswalking developed 
by Peat, Marwich and Mitchell- With this method, current 
accounting methods are "crpsswalked" into a program bud- 
*get format- While this method does not yield infx)rmation 
in as detailed a form as a system designed for program 
budgeting, it does provide decision making information 
of better quality than current systems. j 

5. School district reading specialists expressed their qra- 
• titude that the Department of fducation involved thfem in 

the consideration of new legislation. 



THE EVALUATION DESIGN - 

7/, ' 

Much interest has been expressed by legislators and others in the 
types of projects undertaken under the eAAC program and their costs in 
relation to the benefits derived by the pupils in these projects- The 
problem of this evaluation was to determine the degree to which pupils 
achieved in the various proj^ts and the costs requ/red to support them. 
Three general types of information were needed for each project— cost 
information, program dfccription, and information on student learning- 

To acconplish the above, a beginning point was needed and an ending 
point such that the various projects could be, compared each with the 
others on a consistent ^basis. 

The differences between what projects planned to do and what, actu- 
ally occurred provided some interesting insights into the causes of 
success or lac^^of it In any given project or amonn them. In addition,* 
such implementation data^allows one to guard against appraisinn what 
has been called "non-events" (4). In order contrast effects of dif- 
ferent^programs the programs must, in^fact, be different in actual im- 
plementation and not just in intended differences-. 



Chapter 3 
PROGRAM DESCRIPTIONS 

An important feature of evaluating the Educat/onal Achievement 
Act lies in an examination of the degree of effectiveness of the vari- 
ous program packages which were utilized. 

No attempt was made to utilize a control faroup V groups within 
the evaluation process. It was simply accepted itthe outset that the 
pupils in the program had been selected because the regular school 
prograChad not been producing student learning at an acceptabU-cate.- 
The criteria for selection of these pupils was established in the statute 
22-22 C.R.S. 73. The qufstion encountered with these program^ was whether 
or not they could produce a more acceptable rate of learning for the 
students than had occurred with them in the past. It was also important 
that the programs. utilized would improve or.at least not negativel-y 
affect student attitude toward learning. To teach a child reading skills 
at the expense of also teaching him to hate reading 4nd school was not^ 
considered a desirable outcome. 

The programs themselves defied exact definition with the resources 
available to this evaluation. Within each program, although it was 
generally like another program, vacations occured in practice which • 
altered the activities to make- programs which were generally alike- 
different by virtue of other characteristics. For example, two pro- 
grams ^ould be using DISTAR materials but one w^uld be using teacher 
aides and the other one would not. These kinds of variations were so 
numerous that not all of them could be accounted for. 
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Since financial resources were too limited to send teams of personnel 

.into the field to accurately describe materials and teaching techniques 

being utilized in each program, simple pr^ogram definition technique was 

employed. Jhe Department of Education EAAC program director first made an 

analysis^ of the proposals of all of the funded projects to determine what . 

. program characteristics existed within^'each project. These were reduced 

to a list of 62 variables which supposedly existed in the programs (Appendix 

A). The 62 program characteristics for each program were categorized into 

seven major areas: curriculum, staff, staf^ developiTient,' evaluation, mater- 
j 

ials, equipment, commercial packages, and planning - organizational. * 
On his program monitoring rounds the CDE program director showed this list 
to each local project director. The local project director was then asked 
two questions: (1) which characteristics on the list actually exist in your 
program?, and (2) how would you rank these program characteristics that you 
have selected as being most important in terms of the program you are con- 
ducting? 'Thus, program characteristics were selected and ranked in order 
of importance. • - ' ^ 

An examination of these characteristics revealed that the most constant 
factor which could be used to identify them was th^e major set of materials 
being used by teachers in the program. Each of these materials sets had 

/ 

/ ^ . \ 



*For comparison, ft can be noted that the Educati6nal Testing Service is 
conducting an extensive study of compensatory reading programs in U.S. 
elementary schools (5). In the ETS study some 85 program variables were 
factor analyzed and reduced to five major factors described as follows: 
1 • Emphasis on basic reading activities . 

A program ranking high on thisindex spends more of its class 
time in matching letters or words, learning letter forms, 
developing visual discrimination and sight vocabulary, 
increasing attention span, and improving motor abilities 
^ related to reading than do lower ranking programs. 

ERJC (Continued) 
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other variables associated with them. Fifteen programs were identified on 
this basis for further analysis of program effects. The program descriptions 
,which follow first identify the major materials being irsed and then^the 
^^^Ker important variables which were included and associated wit*i the program 

r 
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(Footnote continued from preceding page) 

2. Emphasis on use of audio-visual materials . 
A program ranking high on this index is Inore inclined than 
lower ranking programs to use a variety of audio-visual aids 
and hardware such as motion pictures, filmstrips, slides and 
transparencies, tape recordings and records, video or TV 
tapes, and newspapers, magazines, and other periodicals. 

3. Emphasis on supplementary reading activities . 
A program ranking high on this index is more likely than a 
lower ranking program to spend time in a variety of activities 
best characterized as supplementary to basic reading instruction 
such as creative writing, independent reading, library 
activities, reading for enjoyment and using ijiany different 
experiences as settings for reading instruction. 

U. Emphasis on instructional flexibility . 

Teachers in prog rams. ranking high on this index tended to 
show a high degree of instructional flexibility, use 
approaches not readily categorized in the standard sense, 
have special training in the teaching of reading and not 
use basal readers. , •» 

5. Emphasis on instruction during time rele ased from other 
schoo l subjects . '. Y f 

Programs ranking high on/th,is ifldex carry out compensatory 
reading instruction in time released from classwork other 
than regular reading instruction since compensatory reading 
^instruction is perceived as a top priority activity, 
using these five indekes ETS was able to distinguish 11 distinctly 
different approaches to compensatory reading. 
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PROGRAM I: DECODING FOR READING, MacMillan Company, publisher 

Decoding for reading is called by its producers a "mult i sensory'* 
program. Its authors were especially interested in meeting the needs of 
upper grade children who had not learned to relate spoken words, to printed 
words. To help pupils make this relationship, the program utilizes the pu- 
pil's familiarity with spoken language- to see hoK the letters of the 
alphabet operate "i| the code" called written English. A sti'dent in the 
program listens to* a record Which tells him a story recorded word for 
word. While listening, the student reads Silently in his text the same 
words to which he is listening. He then completes a companion phonics 
lesson. 



Project 1 

Emphasis given to: 

1-. teaching method 

2. developme^ntal sequence of skills 

3. reading coordinator employed ^ ^ 

4. volunteer aides 

5. special training program for teacher c 
^ 6.. high interest books and reading games^sed to, supplement 



PROGRAM 2: DISTAR, Science Research Associates, publisher 

The Distar System is based on the following principles according -^o 
its authors: . \ * , 

-planning and a statement of behavioral objectives 
-training of teachers in the methods of the program 
-adequate supervisory procedures 

-materials directly relevant to the behavioral objectives 
-providing motivation so that the children want to succeed 
-reinforcing successful behavior 

-maintaining regular, consistent and frequent instruction 
-attending to the learning problems of individual students 
-active parental involvement 

A basic premise is that every student can be' taught^ Teacher presen- 
tations are structured so that stfudents and teachers stay on task. Rewards 
and incentives are provided. 
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Variable Features in Projects 



basic program 




Project 1 



Emphasis given to: 



1. - prescription based on pupil diagnosis 

2. pupils self pacing own learning rate 

3. word recognition skills 
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4. students assisting other students 

5. teacher training 

6. irtdividual pupil diagnosis 

T. wide variety of reading materials available 

8. small group instruction 



Project 1^ ^ 
Emphaslis given to: 

1. i prescription based on pupil diagnosis 

2. I language development \ 

3. reinforcement of reading skills in other content areas 

4. paid teacher aides 

5. university interns used " 

6. teacher and aide training program 

7. early identification of reading difficulties 

8. small group instruction 

Project 21 

Emphasis given to: ' 

1. prescription. based on pupil diagnosis 

2. pupils self pacing at own learning rate 

3. word recognition skills 

4. reading -coordinator ^ 

5. / teacher training 

6. ' individual pupil diagnosis 

7. ' wide var'iety of reading materials available 

8. small group instruction 

PROGRAM 3: SYSTEMS, Scott Foresman Company, publisher. 

Scott Foresman Reading Systems emphasizes a sequential development 
of skills through interesting ma^terial. Children were involved in the se- 
lection of the content/Two comprehension strategies are utilized; pK^^^ 
cues and oral context cues. Regular phonics instruction is included through 
work pages and visual devices. Informal assessment procedures are "sed by 
teachers to keep an account of st^ent needs. Personalized reading is stressed. 
Home-schocl activities are provjddid. 

^ , Variable Features in Projects 

Project 1 

Emphasis given to: 



\ 

\ 



1. prescription based on pupil diagnosis 

2. use of instructional units 

3. pupils self^ pacing of own learning rate 

4. reading coordinator employed 
Q 5. teacher training program i j 
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6. 
7. 
8. 



pre and post testing 

video taped lessons ^ 

staff involvement in activity planning 



PROGRAM 4: LISTEN, LOOK AND LEARN, McGraw-Hill, Inc, Publishers 

Listen, Look and Learh was the basic instructional package used 
in this program. It, is a multi-media communication skills system 
emphasizing basic reading and related language arts skills. It is non- 
graded and organized into instructional units identified as cycles. 
Each cycle is «i4de up of four parts: (1) Perceptual Accuracy and 
VisuaKEfficiency, (2) Building Experiences, (3) Skill Building, (4) 
Indivi^lualized Reading and Related Language Arts. Two pieces of equip- 
ment are used in the program: -the Aud-X and the Controlled Reader. 
The Aud-X is a sight-sound synchronized instrument used to develop 
reading skills through auto-instructional lessons. The Controlled 
Reader is an instrument Which makes use of a moving slot to project, 
printed material on a screen in a left to' right manner at a predetermined 
rate of speed. * 



Emphasis given to:^ . ' 

1. ^. prescription based on pupil diagnosis 

2. pupils^ self pacing of own learning rate 

3. developmental sequence of skills 

4. paid teacher'aides ' 

5. teacher training program 

6. pre- and ppst^ testing 

7. wide variety of instructional reading materials 

8. staff involvement in activity planning 



PROGRAM 5: LEARNING 100, McGraw-Wll Company, publishers 

Learning 100 is a system designed to help the potential or actual, 
school dropout, illiterate adults, or adults in. povert/. It is a multi- 
media program containing cycles of instruction very mudh I'ike program * 
4 except that it is directed to an older population of students. The 
content is oriented toward adults. Six cycles are provided and each 
cycle contains four parts: (1) Perceptual Accuracy and Visual Efficiency, 
(2) Building Experiences, (3) Skill Building,^ (4) Individualized Read- 
ing. Equipment utilized in the program consisfts of the Aud-X, the Con- 
trolled Reader and the Tach X which provides/individual perceptual 



Project 1 



training. 




Variable Features in Projects 



Project 1 



Emphasis given to: 



use of instructional units 
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2. ^ .pupils self pacing of own learning rate 

3- developmental sequence of skills 

4. paid teacher aides ' ' ^ • , 

5. teacher training program 

6. early identification of reading difficulties 

7. wide variety of instructional reading macerials 

8. written goals and objectives 

THE GUARANTEED GRADE GAIN. PROGRAM, Hoffman Information System, 

publisher 

The Guaranteed Grade Gain Program is a-reading laboratory program. 
The core of the pV^ogram is an audio-visual system using filmstrips and 
records for kin44rgarten through sixth grade levels. The program is 
individualized for each child through the use of a teaching machine 
which simultaneously presents a story on record, a story in a booklet 
to be followed with pictures on a. screen. The program is supplemental 
to the regulaV program of reading instruction and is aimed at students 
having reading difficulties. Each lesson has an evaluat'on instrument 
associated with it. • * * « 

. Variable Features in Projects f ^ 

Project 3 • • 

Emphasis given to: 

1. prescription based on pupil diagnosis 

2. pupils self-pacing of own learning rate 

3. increased use of library 

4. employment of reading specialist 

5. dissemination of information about project 

6. individual pupil diagnosis 

7. video taped lessons 

8. use of a reading laboratory 

Project 11 ' ' . . 

Emphasis given to: 

1. developmental sequence of skills 

2. prescription based on pupil diagnosis 

3. token reinforcement for pupils 

4. paid aides 

5. aide training 

6. early identification of pupils 

7. high interest reading materials ^ 

8. small group instruction 



\ 

Project 13 

Emphasi^ given to: 

« 1. comprehension and recall 

2. vocabulary building , \ 

3. word recognition 

4. 'reading coordinator 
. 5. .aide traiining 

6. pre- and post- testing 

7. wide* variety of materials 

8. written goals and objectives 

Project 14 

Emphasis given to: ^ ! 



1. prescription based on pupil diagnosis 

2. pupils self pacing of own learning rate 

3. emphasis on language development 

4. paid teacher aides 

5. outside resource personnel used 

6. individual pupil diagnosis 

7. central bank of materials • 

8. mobile van used ^ 



PROGRAM 7: THE WISCONSIN READING DESIGN, Interpretive Scoring- Systems > 

p qbl isher 

The Wisconsin Reading Design is more of a reading management 
system than it is a package of materials. It is an objective-based 
approach organized into six skill areas: word attack, study skills, 
comprehension, self-directed reading, interpretive reading, and • 
creative reading. The program provides list'o of objeptives, criter^ion- 
referenced tests, management of pupil learnifig with a simple notched 
card system, and a procedure for developing materials locally. It 
also provides a set of materials for the inservice education of 
instructional personnel. One of the basic features of this program is 
that it is possible to tailor the instructional materials to local 
student needs. 

Variable Features in Proje(its 
Projtct 8 I 
Emphasis given to: 

1. developmental sequence of skills 

2. multiple teaching methods * 

3. prescription based on pupil diagnosis 

4. paid teacher aides 

5. aide or tutor training program - 

6. pre-and post^-testing / 

7. wide variety of instructionafV reading materials 

8. needs assessment ' 

' ^2 



-19- 



PROGRAM 8: SULLIVAN PROGRAMMED READING. McGraw-Hill Co.. publishers 

Sul livan Programmed Reading -is a programmed text app^oach to read- 
ing instFuction. In a programmed text the student reads material to be 
learned and immediately aher reading completes a practice exercise ^ 
designed to determine accuracy of learning and reinforce it. Mat- 
erial is presented in a logical sequence in very small increments of 
learning. The student can proceed at his own rate' of speed and even 
though he may be absent -from school, he will not miss critical elements 
* of the material to be learned. One of the advantages of .this method 
is that the student knows immediately whether his answer is correct and 
he does not have to wait for the teacher to tell him the correct answer; 

Variable Features in Projects ' ) 

Project 1 

Emphasis given to: ». 

1. prescription based on pupil diagnosis 

2. language development 

3. developmental sequence of skills 

4. reading specialist j 

5. aide training program ' 

6. individual pupil diagnosis 

7. wide variety of reading materials 

8. parental involvement regaling child 

Project 10 

While the most frequently' mentioned material used in this project 
was Sullivan Programmed Materials, certain schools used other materials 
and great variability was demonstrated in points of emphasis between 
schools. However, from the information obtained, it would seem that 
the following were common points of emphasis: 

1. prescription based on pupil diagnosis 

2. emphasis on vocabulary building 

3. paidf teacher aide 

4. teacper and aide training program 

5. pre and post testing 

&• wide variety of instructional reading materials 

7. small group instruction 

Project 12 

Emphasis given" to: 

emphasis on word recognition skills 
increased use of library . ^ 
prescription based on diagnosis 
paid teacher aides 
aide training program 
wide variety of instructional materials 
small group instruction 

23 
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2. 
3. 
4. 
5. 
6. 
7, 
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Project JS 

Emphasis given to: * * 

!• comprehension and recall of material 

2. vocabulary building 

3. counselling students 
' .4. tutors 

5, tutor training program 

6* early ident^'fication of reading difficulties 

?• high interest reading materials 

8. evaluation plan 

PROGRAM 9: THE READING LABORATORYs Science Research Associates, publisher 

The Read^'ng Laboratory is an individualized reading system based 
on the principle that learning is most effective if the student starts 
at his own level, where he is^;assured success, awd proceetjs as fast as 
his learning rate permits.. 

^] 

Skills taught in the program are ranked on' a difficulty continuum 
from easy to hard. Each student has his own program, beginning at the 
point where he successfully reads and comprehends. ^ 

Both immediate and long-range feedback are provided. The student 
evaluates his own progress. He is presented with increasingly difficult 
materials as his skills develop. 

Variable Features in Projects 
Proj^t ^ ^ r * ^ 

Emphasis given to: 



1. word recognition skills 

2. token reinforcement for pupils 

3. language deve/opment 

4. tutors 

5. tutor traini/ng. program 

6. early ident/if ication of pupils reading difficulties 

7. wide variety of instructional reading materials 

.^^KK^ 8. small groiip instruction 
:^ 

Project 7 

Emphasis given to: 

1. multiple teaching methods 

2. prescription based on pupil diagnosis 

3. use of experience stories 

4. use of reading specialist 



5.. aide training program 

6. individual pupil diagnosis 

7. wide variety of instructional reading material 

8. needs assessment 

PROGRAM 10: PEABODY LANGUAGE DEVELOPMENT. Open, Court Publishing Company 

Peabody Language Development, treats reading as one facet of the 
total language arts domain. The program relies on what the child produces 
lin writing for the exercises, but arc the same time dirett teaching is 

Jt>rovided. Self-teaching guided by the teacher is a fundamental aspect of 
the program. The child's work is evaluated in terms of what he does 
correctly rather than what he does incor/ect-ly. The program generally 
contains the following elements: (1) phonics, (2) story ..background, 
(3) difficult words, (4) silent reading and discussion, (5) oral reading, 
(6) composition. (7) sentence lifting frpm^tudent compositions, 

Hs) proof reStfirfg, (9) vocTabulary- deveWient, (10) researching and • 
reporting. . / ,' 



Variable Features in "Projects 



Project 6 

Emphasis given to: 

1, prescription based ph pupil diagnosis 

'2. developmjBntal sequence of skills 

3. multiple teaching methods 

4. reading specialist 

5. teacher training program 

6. individual /pupil diagnosis 

7. wide variety of instructional reading materials 

8. . needs assessment 

/ 

PROGRAM 11: ECLECTIC, no particular publisher 

An eclectic program does not use any particular set of prepared 
materials. It relies on the teacher possessing a knowledge of what 
-needs to be taught for a child to learn to read. It takes into account 
that different children may learn better with one procedure than another. 
The teacher is provided with many different materials and has the lati- 
tude to select from ainong those materials to provide a child with a 
particular concept he needs. 

Variable Features in Projects^ 
Project 5 , 
/fenphasis given to: 

1. prescription bas6d on pupil diagnosis 

2. developmental sequence of skills 
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3. reteaching 
4* paid aides 

5. teacher training program 

6* individual pupil diagnosis ^ 

?• expansion of library- materials 

8. needs assessment . " 

Project 9 ^ ' % 

Emphasis given to: • ' 

1- vocabulary building . 
2. comprehension and recall ^ * ^ 
2. wbrd recognition ski lis " 

4. reading specialist - * ^ , - 
5- teacher training program ' • 

6. early identification of pypil reading. difficulty 

7. wide variety of instructional reading materials 

8. ' small group instruction j 

Project 16 

Emphasis given to: 

1 • attitudinal change 

2. multiple teaching methods 

3. pupils self-pacing of owrr learning rate 

4. reading specialist 

5. aide training program 

6. individual *^upil diagnosis 

7. high interest reading materials 

8. attention to learning environment 

Project 19 

Emphasis given to: 

I 

1. prescription based on pupil diag4iosis 

2. developmental sequence of skills 

3. use of multiple teaching methods . 

4. reading specialist 7 

5. teacher training program 

6. individual pupil diagnosis 

7. variety of instructional reading materials 

8. 'written goals and objectives 

Project 20 \ / 
Emphasis given to: 

0- prescription based on pupil diagnosis 

2- langyage developtnent 

3. reinforcement of reading skills in other content areas 

4. paid teacher aides ^ * . 

26 
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5. teacher training program 

6. 'early identification of pupils reading difficulties 

7. small group instruction ^ 

PROGRAM 12: SUPPLEMENT BASAL READER, American Book Compan y, publisher 

. The Supplement Basal Reader Program did not depart from the pro 
gram already being used in the school district- The special aspect 
of the program was the provision of special help to those pupils who 
were experiencing low-achievement in relation to their regular school 



Emphasis given to: * 

1. /prescription based on pupil diagnosis 

2. developmental sequence of skills 

3. emphasis on reteaching 

4. reading specialist 

5. outside resource personnel provided 

6. individual pupil diagnosis 

7. central bank of materials 

8. evaluation plan 



PROGRAM 13: INSERVICE EDUCATION 

This program proceeded from the assumption that materials packaaes 
were relatively unimportant in the improvement of readinn ability in 
low-achieving pupils. The' entire emphasis was directed to the improve- 
ment of teachers* ability to deal with low-achieverrent when they 
encounter it. 

project 2 

Emphasis given to: 

1. reading coordinator 

2. staff visits other teachers' classes 

3. teacher training program 

4 provision of demonstration teaching 

5. early identification of pupil's reading difficult.es 

6. pre. and post- testing 

7. video taped lessons 

8. staff involvement in activity planning 



lessons. 



Variable Features of Projects 



Rj^oject 17 
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PROGRAM 14: EQUAL USE OF DECODING FOR READING AND DIST AR 

This program was a combination of the materials used in programs 
1 and 2. Descriptions of the programs are provided under those heading 

PROGRAM 15: EQUAL USE OF DECODING FOR READING AND PROGRAMMED READING 

This program was a combination of materials used in program 1 
and 8. Descriptions of the programs are provided under those headings. 
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Chapter 4' 
RESULTS 

A. DATA COLLECTED ' 
Each of the 21 projects selected their students on the basis of a screen- 
ing test to determine if the child was behind in reading achievement. In 
most cases, this screening was based on the regular school testing prog- 
ram. Pre- tests in attitude and reading achievement were administered in 
- October. The attitude form is shown in Appendix B. It was developed under 
contract by the Laboratory of Educational Research at the University of 
Colorado-Boulder. The comprehension and vocabulary subtests of the Gates- 
MacGinitie Reading Test were used to measure achievement. The attitude 
instrument and reading achievement tests were administered again in 
April or May.' Cost accounting was reported at the end of It he school year 
using the form shown in Appendix C. 

In addition to the scores for each student, data was collected on age, 
grade, sex, ethnic category (American Indian, Black or Negro, Oriental, 
Spanish-surnamed or Chicano, Other), I.Q. scores reported by the district, 
and screening test results. The achievement tests were scored by the 
school and reported for each student. The attitude questionnaires were 
filled out by the students anonymously and returned to the Department. 
The investigators sampled the attitude data within those projects with 
greater than 170 students. 

'/ 

B. STUDENTS AND PROGRAMS 

The reading programs were conducted during 1972-73. Many students, of 
course, entered late or dropped out of the program. The data were grouped 
into four grade groups: 1-3, 4-6, 7-9, and 10-12. It was discovered 

ERIC . 29 . 
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that there were virtually no students in the 10th-12th grades on whom data 
had been collected, so no analysis of the few cases of 10-12 grade records 
was made. The distribution of students on whom data were collected based 
on achievement test reports is shown in Table 1 *• 

The basic analysis was to compare across those programs described in Chap- 
ter 3. Table 2 gives the number of students by program and grade group* 
Programs with very small enrollments were excluded from the program ef- * 
fects analysis. 



Ethnic category figures given are those reported by the teachers. 
Interesting differences occurred between the ethnic category distri- 
bution of students as reported by the teachers and as reported by the 
students themselves. Teachers or other staff members reported ethnic 
categories on the achievement test reporting forms, while the stu- 
dents reported on themselves or the attitude questionnaires. Students 
reported nwre Indian and Other categories, teachers reported more 
Black and Spanish-surname categories. Table A shows these differences. 



Table A 

Ethnic Category of Students by Source of Information 



Ethnic 


Grades 1 


- 3 


Grades 4 


- 6 


Grades 7 


- 9 


Category , 


Teachers 


Students 


Teachers 


Students 


Teachers 


Students 


Indian 


n 


2% 


1% 


4% 


0% 


4% 


Black 


15 


9 


6 


3 


11 


. 7 


Hispano 


39 


37 


36 


31 


21 


19 


Oth^r 


45 


52 


57 


62 


68' 


70/ 


« 


100« 


100% 


100% 


100% 


100% 


100% 
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C. COSTS - ( 

The Colorado Legislature appropriated one million dollars for the 1972-73 
fiscal year to be distributed to projects under the Educational Achieve- 
ment Act. No provisions were made in the legislation for any special form 
of cost accounting; therefore, the traditional line item budget and accoun- 
ting system was used rather than a program budget which could have pro- 
vided better cost analysis. 

The instruments used to determine cost information was a line item budget 
presented at the time of applic^ation for funds, and a financial report 
presented at the end of the program. 

In past years financial information was collected only on the funds pro- 
vided by the State. Many school officials had reported that districts 
were using not only State funds but they were using local funds as well 
in the Achievement Act programs. Naturally,, this fact caused a distorted 
picture of actual program costs. For this reason, districts were asked 
in 1973 to provide an estimate of local fund allocations in their budgets 
and to provide an accounting for them in their financial reports (See" 
Appendix C for examples of these documents). 

The financial reports showed that for every dollar spent by the State, 
approximately one dollar and forty-two cents was spent by local districts. 
The State provided 41 percent -of the money and local and federal funds 
provided 59 percent of the money. Federal funds played only a minor role, 
with most of the additional contributions coming from local sources. (See 
Table 3). 
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The largest item of expenditures from all fund sources was, for instruc- 

* 

tional salaries which contributed 59.2 percent of all expenditures. 
Teaching supplies constituted 18.5 percent of the expenditures and audio 
visual materials accounted for 2.8 percent. School district expenditures 
for administration represented only 1.9 percent of all expenditures (See 
Table 4). r 

For the purpose of this report, the term "project" is used to designate 
the total activities undertaken by a local educational agency to meet 
the purposes of the legislation. The term -"program" is used to designate 
a specific set of inter-related activities designed to carry out the pur- 
poses of the legislation, several of which may have been contained within 
a project. Programs are identified by the most frequently used materials 
in- them or where materials were not emphasized, they are identified by 
the type of service. . 

Total projects costs ranged from a low of $25.08 per pupil to a high of 
$522.74. The mpdian total cost for projects was $173.37. The average 
'total cost for projects was $180.53. (See Table in Appendix D). 

Because of the fact that line-item project budgeting and accounting was 
used rather than program budgetinc, and accounting, program costs cannot 
be accurately determined. However ^ since many of the projects contained ' 
a single program, it was possible to derive a reasonable estimate of 
program costs. Per pupil program costs were based on tht? number of pupils 
contracted to be served in project applications rather than on the number 
witi! reported achievement data. This was done because of unreported data 
in' achievement reports and it provided a more realistic figure in terms 
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of the population served- 

I 

Total per jiupil program costs ranged from a low of $25,95 to a high of 
$227.48. The niedian per pupil total program cost was $173.37. The mean 
per pupil total program cost was $180.53 (Table 5). 

It should be noted that little control over local and federal cost figures 
was available and that those at the extremes of low contributions and 
high contributions may have tended to exaggerate their contributions, 
thus, the program with the lowest per pupil. expenditure was an inservice 
education program and actual reading program costs were not reflected. 
It is not known what factors were considered in allocating local and 
federal costs in the higher priced programs. All salaries of teachers 
in regular school programs may have been reported when in fact the request 
was for costs directly attributable to the reading project purposes. 
Local salary schedules^ which can differ by 25 percent^ make cross-district 
comparisons difficult. 

. D. ACHIEVEMENT 

Overall, over the six or seven months between pre-and post-tests, the 
students gained from seven to twelve months in reading achievement. At 
the , time of the pre-test, the students had been averaging six to eight 
months gain per year with about one-third of the students averaging seven 
to nine months gain per year. During the 1972-73 programs, well over 
half of the students gained seven months. The primary grades showed the 
least increase in rate of gain in reading comprehension. Table 6 shows 
several measures of reading gain by grade group. 
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Several criterion variables were considered. Gain scores were computed 
f«r vocabulary and comprehension. The correlation across students between 
vocabulary grade equivalent gain and comprehension grade equivalent 
gain was .47 in grades 1-3, .29 in grades 4-6, and,. 14 in grades 7-9. 
l\addition, the post test difference between actual grade placement 
^ and\test grade equivalent was computed (months behind arade placement). 

i 

Furthermore, the grade equivalent scores reported by t'.e jprojects were 
•converted to standard scores from the publishers' norm tables. Standard 
scores have the advantage' of a regular distribution and statistical 
soundness for comparisons across grades, time and tests. jcrade equivalent 
scores have the advantage of ease of interpretatifrfTand ^ml^liarity for 
most readers. The correlations between standard scores and grade equiva- 
lent scores were in the.70*s for grade group 1-," in the .50's for grade 
group 2, and in the .90' s for grade group 3. When the programs were 
ranked for their gain, the correlations between rankings basecwn grade 
equivalent scores and rankings b4sed on standardized scq|;es varied only 
from .86 to 1.00. In order to simplify the presentation of results, and * 
since only minor differences would occur by using one form or another, 
results will be presented using the grade equivalent analyses. 

Program Comparisons 

The achievement analysis attempted to answer the question: "Was there 
a difference in achievement among programs?" 

Since no assignment of students to programs wa^ possible, and since we ' ' 
know the^ different programs were in different projects or school districts, 
it was expected that the students woi^d differ among programs. Because > 
of the difference among districts and the large sample sizes, virtually 

w 
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all tests for sample differences were significant, notably in ethnic 
distribution and in pre-test scores. 

Inasmuch as there were sample differences, achievement gain analyses 
were run, adjusting for pre-test differences. Analysis of covariance 
was used, using as covariates age, grade, sex, ethnic category, and months 
behind grade placement on the pre-tests for vocabulary and comprehen- 
sion. 

Table 7 presents the gains in grade equivalent by program without adjust- 
ment (covarying) on sample characteristics. Covarying on the six variables 
indicated above did make a difference in results. The multiple correlations 
between the criterion gain scores and the covariates ran from .27 to .41. 

Table 8 presents the comparisons among programs before and after adjust- 
ments ( parti aling out effects of covariates). Rather than present the 
results in terms of computed effects, the programs have been ranked with 
the first rank going to the program showing the most gain. Attention 
shouldje^pa-id- primarily to the adjusted score rankings in order to take 
"account of student differences among programs. 

The following programs, in order, showed the leading gains in grades 1-3: 

11 . Eclectic approach 

12. Supplemental help-aides 
9. SRA Reading Laboratory 

4. E.D.L. Listen, Look and Learn 
7- Wisconsin Reading Design 

13. Inservice Education 

8. Sullivan Programmed Reading 



-38- 



r 



a 
pa 



a 





a 








s 






pa 






>« 












CO 








M 




< 




a 




H 




z 




pa 




1 




M 








cr 




pa 




pa 



CO 
PC 
H 

O 



I 

O 

M 

CO 

pa vo 
o 



D I 

u 
o 
> 
cn 
t 



•H iH rH * in 

CO I I I a\rHco\Hcno<r rHoo 

f< rH rH rH 

\ 



I vor^co I oocj\o\o\cocvjcoo\vOvO 

T-i rH 



1 i 1 ivotnoNQOi io\t 



t I 



^ I I vo I ooo\ooo\cor^o\vOvo 



! 00C0O\ I OOCOOrH^CvJrHOOOOOO 



s ^ § 



CO * 

pa 

H H H 
CO CO CO 
M >i M 
Q CO _J 



CO 



CO 

o 
u 

CO 



\0 



CO 



00 



2: 



(14 
o 
1-1 

pa 
> 
pa 

Q 

i 

a 



Q 

O 

pa 
(I4 













0 






M 




HEL 


UCAT 






Q 






pa 












pa 


a 




a 


M 




M 


H 












pa 


cu 


pa 


CL 


TIP 




pa 


CO 


M 



▻4 
o 

o 



o 
a 



00 

I 



o 
o 

§ 

o 
a 



CO 
0) 
4J 
I 

(U 

a 

1^ 
o 

CO 

u 



V4 
0) 

U 

s 

o 



CO 




u 




0 








4J 












§ 








CO 




3 










• 


(0 JS 






4J 


g 


3 




0 












•H 


CO 








1^ 




CO 








% 






•H 


u 


cd 












XI 






0 




rH 


0 






> 




•H 




3 




tr 




0 






CO 


0) 


<u 


•0 




Cd 


0 




0 


0 


CO 


•* 




pa 




H 




0 









ERIC 



12 



4 



-39- 



1-4 

t-i 



ERIC 



I 

CO 



o < 

Cg 
O 



I 

CO 



o ^ < 

CO 

o 



CO 

I 



•o < 

o 



i 



<M m 



m CO <M \o 



CO I 



I ^ I 



I I 



I I 



I ^ CM CO I I r-l I <n I 



CO I I CM I vo I 



I o\ I m CO CM CM vo 



St 00 



00 



I O I lO^^-r^CMCMVOfHCOOk 



I ON I m CO vO CM C4 00 iH 



1^ iH O 



CO 



I Oi I m 



cMe CM iH o 00 



I O 00 ^ I On vO CO CO 



I iH On I 00 CO CO CM 



CM m CM 



in CM o 



I o tn 



I 00>^r^CMC0iHC0O%iH 



I iH vO iT) lOO-^f^CMCOtHCOO^CMO 



1^ 

S 2S 



H 
CO 



CM 



H 
CO 



CO 



o 


o 


o 




■H 








O 








M 










o 







H 
O 

d 



00 



CO 



CM 



o 

H 



CO 

2 



CO 



CM 



O 

o 



i 



o 
o 



in 



13 



cd 

CD 
00 



cd 

JO 

S CO 

M 
01 o 
M o 

0 CO 

o 

CO w 

U I 
CD « 
9 M 

'1 

01 >v 
«H M 
^ O 
•H 00 
C 0> 
•H 4J 
O «0 

3^ 
Si 

Cd 01 

o 

C M 

O 41 
CO 

CD 

(3 * 

«H 01 

Cd «tl 
00 Id 

M 

• 00 
H 

• * 

0 01 
00 

6 «0 

o 

•o o 

0> 

a « 

cd 4J 

^ o 

01 

01 ^ 

Cd 0) 

CD 4J 

:i 

O H 

^ % 
CO H 
4J 

S Of 



-40- 



/ 

/ 



3. Scott Foresman SYSTEMS • / 

6. Hoffman Guaranti^ed Grade Gainy^ 
2. SRA DISTAR, / 

The^Distar program may have^ suffered in comparing gain by being used 
in one of the/two Distar projects with only unusually behind students. 
The other three programs not listed failed to reach expected gain levels. 
The correlation between vocabulary gain rank and comprehension gain rank 
was .92" (P<.001). In grades 4-6 the following programs, in order, 
showed the most gain: 

12* Supplemental help— aides 
9. SRA Reading Laboratory 

7. Wisconsin Reading Design 

6. Hoffman Guaranteed Grade Gain 
13. Inservice Education ^ 

1. McMillin Decoding for Reading 
11 . Eclectic approach 

8. Sullivan Programmed Reading 

The other four programs not listed l^ailed to reach expected gain levels. 
The correlation between vocabulary gain rank and comprehension gain rank 
was .79 (p <.01). 

In grades 7-9 there was virtually no correlation between vocabulary 
gain rank and comprehension gain rank (r=.03). The eclectic approach 
showed the most gain. The Wisconsin Reading Design showed high grade 
equivalent gain but in covariance analysis, the comprehension gain came 
in -^ifth. All six programs reached expected gain level in comprehension 
and in the average of comprehension and vocabulary scores, in the fol- 
i-ni^ lowing order: 
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11. Eclectic approach 

7, Wisconsin Reading Design 

8. Sullivan Programmed Reading ^ 
6. Hoffman Guaranteed Grade Gain 

13. Inservice education 

5. E.D.L. Learn 100 

Ethnic Category Comparisons 

Ethnic category differences in achievement were significant at all three^ 
grade levels. Table 9 presents the months gain in grade equivalent scores 
in vocabulary arid comprehension and the rank order of the ethnic cate- 
gories in effect on gain after partialling out the effects of age, grade, 
sex, and pre»test values in months behind grade in yocabulary and com- 
prehensiooA/ 
'\ 

As Table 9 sho^s, the "Other" ethnic category gained the most, Spanish 
surnamed AmericanS-gained next most and Blacks gained least. In all cases 
the ethnic variable was significant, although in some vocabulary gain j 
contrasts the difference between Black and Chicano effects were nonsigni- 
ficant (that is. Black and Chicano gained about the same and "Other" 
gained significantly more). 

E. ATTITUDES 

The attitude questionnaires, because they were answered anonymously, could 
not be linked at the student level with either post-test attitudes or 
achievement. The items were each answered: Yes,.?, No. Responses of don't 
know, not sure, or sometimes yes— sometimes no were to be answered by 
circling the question mark. Coding for analysis was: Yes=l , ?=2, Nc=3. 
The percent answering yes to each item is shown in Appendix E. 
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In order to yjeduce the 28 items to a more manageable set, the pre -test 
questionnaire responses were factor analyzed withinTeach grade' level 
(principal axes, oblique rotation on the SPSS statistical computer pac- 
kage). A detailed report of th€ factor analysis results will not be pre- 
sented in this report. The six factors extracted were compared across 
gr|ide levels since common factors or items at all grade levels were 
*desired in order to reduce complexity in reporting results. Three fac- ^ 
tors were found in common. The first factor in each analysis did not • 
contain items in common across the three grade groups, so the items from 
the first factor were used as single item measures- 



The six attitude measure's derived are indicated in Table 10. The scores 
for themulti-item factors were the mean item response. Lower attitude 
scores meant more favorable attitudes. The pre- test attitude scores were 

« 

analyzed separately by sex, ethnic category, and program. 

Overall, most attitudes were less favorable in the spring than in the 
fall. "Liking school" in particular dropped off from fall to spring. 
Factor 3 (reading better) and factor 6 (actually reading) showed the 
most gain in attitude. Factor 5 (self image), logically an important 
variable, showed the least change during the reading programs. The 
• younger students generally had more favorable attitudes than the older 
students, except in factor 6 (reading) where the older students reported 
more reading. On the other hand, the younger students showed more nega- 
tive change and ihe older students more positive change. 

On all factors in grades 1-6, and all but two in grades 7-9, girls 
%, showed more favorable attitudes than boys. There were significant differ- 
if/-- cnces between boys and girls' scores on all but factor 3 (reading better), 
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but in general, boys and girls changed scores in the same direction. 
Attitude Changes by Program 

Each attitude factor within each grade group was analyze^ across reading 
programs. In nearly all cases, there were significant differences among 
programs on pre-test and post-test attitude scores. Looking at differences 
between pre- and post-test means within each program showed that about 45 
percent of the attitude changes were significant (t test for correlated 
means). Of the significant changes, 37 percent of the grade 1-3 changes- 
were favorable, 61 percent of the grade 4-6 changes were favorable, and 
76 percent of the grade 7-9 changes were favorable. Since the older stu- 
dents started 'with less favorable attitudes, the result is that the ini- 
tially high and low groups moved toward the center. (See Appendix F for 
^ tables showing pre-and post-test mean scores by program). 

In general, the programs did hot produce consistent attitude change (Table v 
11). In grades 1-3 the following programs produced the most favorable 
changes: 

12. Supplemental help (aides) 

14. Combination of Distar and Decoding for Reading 

3. Scott Foresman SYSTEMS 

Unfavorable attitude changes were most associated with: 

4. E.D.L. Listen, Look and Learn 

6. Hoffman Guaranteed Grade Gain 

7. Wisconsin Reading Design 

15. Combination of Sullivan and Decodi g for Reading 

In grades 4-6, "the following programs produced the most favorable attitude 
^ Changes: 

ERIC 
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1. McMillan Decoding for Reading 
11 . Eclectic Approach 

4. E.D.L. Listen, look and Learn 

14. Combination of Distar and Decoding for Reading 
Unfavorable attitude changes were mo^t associated with: 

15. Combination of Sullivan and Decoding for Reading 
6. Hoffman Guaranteed Grade Gain 

8. Sullivan Programmed Reading 

In grades 7-9, the following programs showed the most favorable attitude 
changes: 

9. SRA Reading Laboratory 

5. E.D.L. Learning 100 

8. McGraw-Hill Sullivan Programmed Reading ^ 
13. Inservice Education 
Unfavorable attitude changes occurred only in: 

6. Hoffman Guaranteed Grade Gain 

Ethnic Differences in Attitude 

There were significant differences among ettinic categories (Black, Chicane, 
Other) in their reading attitudes in grades 1-6. Only three out of 12 
attitude comparisons were significantly different in grades 7-9. 



In grades 1-6, the "Other" category (mostly caucasion) had the least 
favorable attitudes. In grades 1-3, the Spanish surnamed had the most 
favorable attitudes, and the Blacks were in the middle in attitudes. In 
grades 4-6, the Black* and Chicano varied in Kolding the most positive 
attitude. In grades 7-9, no one group was consistently high or low in 
attitude. 
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In terms of change scores, all ethnic categories in grades 1-3 became 
less favorable on factor 1 (like school). Blacks and Spanish surname 
reported reading less by the end of the year, "Other" reported reading 
more. In grades 4-6, all ethnic categories reported reading more but 
liking to read to others less. Blacks reported liking school more but 
not reading better than the previous year, while the Spanish surname 
and "Other" categories liked school less but felt they were reading 
better than the last year. In grades 7-9, the Blacks showed more un- 
favorable attitude change than either the Chicano and "Other" 
categories.*^ All groups reported reading better than last year, but 
the Blacks reported reading less while the Hispanos and "Other" 
reported reading more. 
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Chapter 5 
CONCLUSIONS 

The additional' reading program effort produced by Ihe funds in the 
Colorado Educational Achievement A-t did lead to Increased gains by 
students who were behind in reading achievement. Students who had been^ 
averaging six to eight months reading gain p^r, school year before. the X 
program increased their gains by an average of more than 50 percent. That 
is, over just the seven months of the testing period the students in these 
projects- averaged seven to twelve months gain, depending on grade level 
and test. Most programs showed moderate reading achievement gains of 
seven to nine months during the seven month testing period. A few programs 
showed high gain and a few gained less than grade equivalent or gained less 
than the students had averaged before the program started. Attitude changes, 
for the mpst part, were neutral, with as many unfavorable as favorable 
changes occurring. Table 12 summarizes achievement and attitude change by 
reading program and grade* 

Among the more successful programs in terms of positive achievement 
growth and positive attitude change the following characteristics were 
found to be most common: 

a prescription based on diagnosis of pupils 
a developmental sequence of skills 

a wide variety of instructional reading materials available 

pupil problems identified early 

staff involvement in planning 

paid teacher aides 

aide training 

teacher training 

A cost-effectiveness analysis of the data was performed which is 
subject to the following limitations: 



\ 



ERLC 



-50- 



4 



1 







CM 














o 



















H 



7 



o 



< 
o 

UJ 

> 

HH / 

X 

u 
< 











<r 






































O 


in 






o 


*n 












•H 


r-i 








iH 




> 








<0 






















•H 




























iH 
















CO 


vO 




iH 




00 




00 




























CO 


CN 






•H 


•H 


NO 




















eg 




















































r-i 






•H 








OS 








•H 




CN 
























































































> 


> 












M 




M 


H 




H 


M 




M 


H 


1 




H 1 






H 






H 






H 






H 






CO 






CO 






CO 






O 






O 1 




O 






P4 






P4 ! 






P4 : 


2S 





§ 

QO 
CO 

2> 




I I I I I I I I I I I I I I I 

c>j<n«;rinvor~ooo»OiHc>j<n«;rm 



CO 



ERIC 



-51- 

1. All programs showed a reasonable degree of pupil improvement, 
therefore the cost effectiveness analysis is restricted to 
productive programs rather than a comparison with non-productive 
programs. 

2. Only one year of study 'imits the degree of confidence one can 
place in the results. If programs retained their relative rank 
over— several fiscal years one could assume with more confidence 
that the cost-effectiveness rankings established during this year 
were reasonably accurate. 

3. One must not assume that because we have utilized the educational 
materials as a means of identifying programs, that the materials 
are exclusively responsible for the results. Most of these 
materials have been rather thoroughly field tested and researched 
by their publishers prior to publication. Other variables are 
present in all cases, some known and others unknown, which 
contribute to the results of the program. 

Three factors were taken into account in making a determinatiorf of 
cost-effectiveness: (1) ranking of total per pupil costs, (2) ranking of 
achievement gain in comprehension and in vocabulary, and (3) ranking of 
attitude improvement or loss. In all cases the rankings were from 1 to 15 

A 

and combined across all three grade groups. 

Total costs from all sources; local, state and federal, were divided 
by the number of pupils in the program. These were ranked with the lowest 
cost assigned the number 1 and the highest cost assigned the highest number. 
Identical costs were assigned identical rank numbers. 
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\ 

Achievement gains as measured by the Gates-MacGinitie reading 
test were ranked with the greatest gain assigned the number 1 and the 
least gain assigned the highest number. Icl3»^^ical gains received 
identical rank. 

Attitude factors were ranked by assigning +2 to Favorable factors, 
-2 to Unfavorable factors and 0 to Neutral factors, then dividing by the 
number of factors reported to derive a total rank score. Rank scores 
were then ranged with the most favorable score ranked 1 and the least 
favorable ranked highest. 

All rankings, cost, achievement and attitude, were then totaled to 
a composite score and ranked with the most cost-effective assigned a rank 
of 1 and the least cost effective assigned the highest number. Identical 
scores received identical rank nunbers. Table 13 shows the programs ranked 
considering all these f^xtors with the program indicated as being the most 
cost-effective ranked 1. It should be noted that the first four programs in 
rank order are those which leave considerable latitude to teichers in 
deciding what materials to use with the pupil. 

It should be noted also that in considering cost-effectiveness of 
these programs that there were intervening variables which were not accounted 
for, such as the fact that some programs had experience with such projects 
prior to this year and some did not, or staff turnover may have made a 
difference and countless other variables. The rank numbers given should be 
^ treated only as indicators, not absolutes. No reflection on the quality of 
program materials is intended through these rankings, for the same materials 
in another context could very well show a different rank order than the one 
emerging from this situation. 
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Table 13 



SUMMARY 


OF PROGRAM 


EFFECTIVENESS RANKS 








Mean Rank Across 


Grades 


-- 






Vocabulary 
Gain 


Comprehension 
Gain 

- 


Attitude 
Gain 


Cost 


Total 
Rank 


SRA Reading Laboratory 


2 


2 


5 


3- 


1 


Supplemental Help 


1 


1 


3.5 


7 




• 

Eclectic 


3 


3 


6 


2 


3 


Staff In-Service Education 


11 


k 


7 


I 


1. 
*t 


Wisconsin Reading Design 


k 


6 


12 

* 


r 
D 


r r 

5o 


Decoding for Reading 


5 


12 


1 


10 


5-5 


Sullivan Programmed Reading 


7 


8 


9.5 


5 


7 


Guaranteed Grade Gain 
Program 


10 


5 


1i» 




o 
o 


Learning Systems 


6 


9 


9.5 

• 


1 U 




Learning 100 


9 


I'*. 5 


2 


10 


10 


Listen, Look and Learn 


8 


7 


9.5 


13 


11 


Combination: Distar and 
Decoding 


1^* 


11 


3.5 


10 


12 


Distar 


12 


10 


13 


15 


13 


Combination: Sullivan and 
Oecod i ng 




13 


15 


10 




Peabody Language Development 


15 


1i».5 


9.5 




15 



\ 
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The following conclusions, based on the findings from this study, 
offered to persons planning program development in reading achievement: 

1. Additional effort, made possible by the incentive of 
additional funds, can produce significant reading 
achievement gains. 

2. Inservice education for aJl teaching staff which is 
relevant to reading remediation in the classroom can 
produce results. 

3. When programs are established, the data seems to show 
that those which allow the teacher wide latitude in the 
choice of materials and procedures produce good results. 



4. 



Organized commercially prepared programs may or may not 
produce results depending upon a wide variety of other 
variables in the learning environment. 




V 
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APPENDIX A 



PROGRAM CHARACTERISTICS 



EDUCATIONAL ACHIEVEMENT ACT FY 1973 



CURR'iCULUM CHARACTERISTICS 

1. Prescription based on pupil diagnosis 

2. Emphasis on language development 

3. Use of instructional units 

4. Accomodation of pupil learning rate through self pacing 

5. Token reinforcement for pupils 

6. Use of a developmental sequence of skills to be learned 
*7. Use of multiple teaching methods 

8. Emphasis on vocabulary building 

9. Emphasis on v;ord recognition skills 

10. Use of experience stories 

11. Emphasis on reteaching 

12. Reinforcement of reading skills in other content areas 

13. Emphasis on the study skills 

,14. Emphasis- on comprehension and recall 

15. Provision for counselling 

'16. Increased use of library 

STAFF CHARACTERISTICS 



17* 


Volunteer aides 


18. 


Paid aides 


29. 


r.- 'id3 cooL*:'in:;l or 


20. 


Reading specialist 


21. 


University interns 


22. 


Psychologist 


23. 


Speech Therapist 


24. 


Counselor 


25. 


Students assisting other students 


26. 


Tutors 



27. Provision of aide or tutor ^raining program 

28. Provision of teacher training proqram y 

29. Provision of demonstration teaching — 

30. Staff visits other teachers classes 

31. Outside resource personnel provided 

32. Project has design for dissemination 

E V ALU AT I ON CI 1 A ?^".C TC RT S T T C S • 

33. Children havina difficultv with reading identified early 

34. Individual pupil diagnosis 

35. Pre and post testing 



STAFF DnVELOPMEt^!T CHARACTERISTICS 
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yiATERIALS AND EQUIPMENT CHARACTERISTICS 

36. Video taped lessons 

37. Central bank of materials 

38. Expansion of library mater^ials 

39. Multicultural materials 

40. ReadiFng games ' 

41. Wide variety of instructional reading materials 

42. High interest reading materials 

COMMERCIALLY PREPARED INSTRUCTIONAL PACKAGES 

43. Distar 

44. Dor sett 

^ 45. Other (name) 

46. ^ Teaching machines 

47. Audio-visual equipment 

48. Tapes 

49. Filmstrips (, 

PLANNING AND ORGANIZATIONAL CHARACTERISTICS 

50. Parental involvement in planning 

51. Parental involvement regarding child 

52. Needs assesment 

53. Written goals and objectives 

54. Staff involvement in activity planning 

55. Evaluation plan 

56. Reading laboratories 

57. Attention to learning environment 

58. Team teaching 

59. Mobile van 

60. Small group instruction 

61. Home visitation 

62. Public information 



Robert F. Cheuvront 
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APPENDIX B 

COLORADO READING ATTITUDE INVENTORY 

Directions for Administration . The time required to administer this inventory is 
10-20 minutes depending on gr^de level. Each student should have a copy of the 
special answer shelt, a pencil and an eraser. Pens should not be used. The 
directions to be read to the students are capitalized. Before starting the test, 
print the name of the school, the school district and the teacher on the black 
board, arranged in the order it is requested on the answer sheet. If possible 
arrange for a proctor to help answer the questions that will be asked by individual 
pupils, especially at "'the primary grades. ^ 

WE WOULD LIKE TO KNOW HOW STUDENTS FEEL ABOUT BOOKS AND READING. EaCH OF 
YOU SHOULD HAVE A PENCIL, ERASER, AND A SPECIAL ANSWER SHEET WITH THe" WORDS 
"COLORADO READING ATTITUDE INVENTORY" AT THE TOP. RAISE YOUR HAND IF YOU DO NOT 
HAVE THESE ITEMS (pause). 

NOTICE THAT THERE ARE SEVERAL BLANKS AT THE TOP OF THE ANSWER SHEET. PLEASE 

FILL IN THE BLANKS LIKE THE EXAMPLE ON THE BLACKBOARD. FOR QUESTION "A" WRITE 

THE NAME OF THE SCHOOL. FOR QUESTION "B" WRITE THE NAME OF THE SCHOOL DISTRICT 

AS SHOWN ON THE BLACKBOARD. WRITE YOUR TEACHER'S NAME FOR QUESTION "C". 

(Note, if a student has more than one 'teacher, use the name of the reading 

teacher.) FOR QUESTIONS "D" AND "E" GIVE YOUR GRADE AND AGE. (pause) FOR 

QUESTION "F", PUT A CHECK MARK BY BOY OR GIRL. FOR QUESTION "G", PLACE A CHECK 

MARK TO SHOW IF YOU ARE AN AMERICAN INDIAN, NEGRO ORIENTAL, OR CHICANO. MARK 
m 

"OTHER" IF YOU DO NOT BELONG TO ANT OF THE GROUPS LISTED. RAISE YOUR HAND IF 

YOU HAVE A QUESTION ABOUT MARKING QUESTION "G" . (For pupils in the primary grades, 

the, teacher and proctor will need to help the pupils with this question.) . 

I.AM GOING TO READ SEVERAL QUESTIONS ABOUT BOOKS AND READING. PLEASE BE 
COMPLETELY HONEST IN YOUR ANSWERS, NOTICE THAT, YOU DID NOT WRITE YOUR NAME 
ON THE ANSWER SHEET. NO ONE WILL KNOW HOW YOU AI-ISWERED THE QUESTIONS EXCEPT 
FOR YOU. THIS IS NOT A TEST WHERE THERE IS A CORRECT ANSWER. THE CORRECT 
ANSWER FOR YOU MAY SB DIFFERENT FROM THE AI'JSWER THAT IS CORRECT FOR SOMEONE ELSE. 
THE CORRECT ANSWER IS THE ONE THAT'S TRUE FOR YOU. 
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I WILL READ A QUESIION, THEN YOU WILL ANSWER IT BY CTRaiNG "Y£S" OR "NO." 
FOR EXAMPLE, FIND "H" ON YOUR ANSWER SHEET. QUESTION "H" IS "DO YOU LIKE TO 

» 

DRAW?" IF YOU DO LIKE TO DRAW, CIRaE THE WORD "YES" ON YOUR ANSWER SHEET K»R 
QUESTION "H". IF YOU DO NOT LIKE TO DRAW, CIRCLE THE WORD "NO." IF SOMETIMES YOU 
LIKE TO DRAW A.ND SOMETI^IES YOU DO NOT, CIRaE THE QUESTION MARK TO SHOW THAT THE 
ANSWER IS SOMETIMES YES AND SOMETIMES NO. DO NOT SPEND A LOT OF TIME THINKING ABOUT 
YOUR ANSWER. JUST MARK THE FIRST ANSWER THAT COMES TO MIND. BE SURE TO ANSWER 
EACH QUESTION. 

FIND "I" ON YOUR ANSWER SHEET. "DO YOU READ VERY FAS^?" MARK YES OR NO. 
IF YOU FEEL YOU NEITHER READ FAST OR SLOW, OR IF YOU ARE NOT SURE OF YOUR ANSWER, 
CIRCLE THE QUESTION MARK. 

REMEMBER WE WANT TO ENCOURAGE Y0« TO GIVE YOUR TRUE FEELINGS, BUT ANSWER 
QUICKLY WITH THE FIRST ANSWER THAT COMES TO MIND. BE SURE TO MARK AN ANSWER 
TO EACH QUESTION, EVEN IF YOUR ANSWER IS THE QUESTION MARK. IF YOU DO NOT 
UNDERSTAND A QUESTION, RAISE YOUR HAND. (You may clarify any question using 
language familiar to the students). 

I WILL READ SEVERAL QUESTIONS AND YOU WILL CIRCLE THE FIRST ANSWER THAT YOU 
THINK OF. BE SURE TO ANSWER EVERY QUESTION QUICKLY. PLEASE DO NOT LOOK TO SEE 
HOW OTHERS HAVE ANSWERED THE QUESTIONS. IF YOU WANT ME TO REPEAT A QUESTION, RAISE 
YOUR HAND AND I WILL READ THE QUESTION AGAIN. ON YOUR ANSWl^R SHEET, FIND NUMBER 
ONE. QUESTION ONE IS (read the question, pause. No one should circulate 
among the students while the students are taking th^ inventory, except to 
answer questions.) HAS EVERYONE ANSWERED QUESTION ONE? QCr.STION NUMBER TWO: 
(read the question, pause. Continue through question 30. Keep the students 
working quickly.) TURN Y^bl^R ANSWER SHEETS OVER. (Have the answer sheets 

collected. ) 

■» 

o 
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Colorado Reading Attitude Inventory 



1 



1. 



Do you like school? 



2. 



Do you like to read? 



3. 



Do you read at home? 



4. 



Do you read books cfr magazines even when you don't have to? 



5. Do you check out books from the library? 

6. Do you read parts of the newspaper every day? 

7. Do you like to get books as gifts? 

8. Do you find most books that you read interesting? 

9. Are most things you learn from books important? ^ 

10. Are you reading much better now than you did last year? 

11. Do you read very slowly? 

12. Do you h^ve trouble remembering what you read? 

13. Can you remember a story better if you read it yourself than if the story is 
read to you? 

14. Do you, of ten daydream while you are reading? 

15. Are you pleased about how well you read? 

16. Can you sound out new words in reading? 

17. Do you like to read "to your teacher? 

18. Do you like to read to your parents? 

19. Do you think that most books at school are hald to read? 

20. Do you like to look at magazines? 



21. 




22. 



Do you like\o read to yourself? 



23. 



Do you like to read to others? 



24. 



Are your parents satisfied with how well you read? 



Laboratory of Educational Research, University of Colorado, 1972 
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2 



25. Do you like to read more than most kids your age? 

26. Do you think you read well for your age? 

27. Do your teachers care about how well you read; 

28. Do you plan to finish high school ? 

) 

I 
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APPEUDIX E 
COLORADO READING ATTITUDE INVENTORY! ITEM RESPONSES 



PERCENT ANSWERING YES 



ERIC 



ITEM 


GRADr 
PRE 


V3 
POST 


GRADE i»«6 
PRE POST 


GRADE 7-9 
PRE POST 


L 


uo you 1 ike scnool / 


77 


ii 


50 


44^ 


30 


25 


2* 


Do you ] I ke to read 7 


67 


6t> 


53 


50 


32 


29 




Do you read at Hone? 


58 


56 


A8 


Ho 


"37 




I, 


Do you read books or magazines even when you{ don't 




» 












have to? 


ii8 




55 


55 


56 


61 


S* 


Do you check out books from the library? 


7't 


78 


77 


78 


60 


59 


6. 


Do you read parts of the newspaper every day? 


. 28 


28 


25 


32 


42 


45 


7. 


Do you like to get books as gifts? 


76 


73 


55 


48 


25 


20 


8. 


Do you find most books that you read Interesting? 


6<> 


60 


63 


59 


51 


48 


9. 


Arc most things you learn from books Important? 


68 


68 


61 


58 


44 


39 


10. 


Are you reading much better now than you did last 
















year? 


81 


80 


73 


76 


57 


72 


IK 


Do you read very slowly? 


50 


39 


37 


30 


32 


25 


12. 


Do you have trouble remembering what you read? 


52 


'•7 


48 


4o 


47 


35 


13- 


Can you remember a story better If you read It 
yourself than If the story Is read to you? 


58 


59 


53 


52 


50 


f 0 
48 


14. 


Do you often daydream while you are reading? 


38 


39 


48 


46 


62 


60 


15. 


Are you pleased about how well you read? 


71 


69 


46 


45 


30 


33 


16. 


Can you sound out new words In reading? 


67 


72 


53 




^3 


46 


17. 


Do you like to read to your teacher? 


69 


68 


35 


30 


12 


10 


18. 


Do you like to read to your parents? 


77 


7'. 


49 


43 


! 16 


14 


19. 


Do you think that most books at school are hard 
















to read? 


37 


28 


23 


16 


. 17 


12 


20. 


Oo you like to look at magazines? 


70 


67 


77 


78 


86 


83 


21. 


Do you like to read magazines? 


1. <« 

n 




39 


39 


42 


46 


22. 


Oo you like to read to others? 


71 


69 


69 


69 


! 66 


62 


23. 


Oo you like to read to others? 


Sh 


52 


30 


29 




14 


2A. 


Are your parents satisfied v/ith how well you read? 


77 


71 


44 


41 


24 


27 


25. 


Do you like to read more than most kids your age? 


57 


52 


32 


26 


■ 15 


11 


26. 


Oo you think you read well for your age? 


68 


67 


43 


41 


' 29 


34 


27. 


Oo your teachers care about hov/ well you read? 


78 


78 


77 


76 


; 57 


57 


28. 


Oo you olan to finish hinh school? 


76- 


7k 


81 


78 


89 


83 


TOTAL 2.131 2 


J93 1 


,963 


2,221 


7S0 


91s 
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